— hee 
Swale мой 
& Doone Marka ӨТ“ Monte С 4 


| 
(MK MC | 


 ———— ——  —— 


Information theory, pattern 
recognition, and neural networks 


ы ©1 Noisy-channel coding 
Ө Source coding (Data compression) 
ssi 22 Information content, entropy 
©3 Typicality and the source coding theorem 
94 Symbol codes 
5 Symbol codes and Arithmetic coding 
" @Noisy-channel coding 
©6 Information measures for noisy channels 
97 Capacity of a noisy channel 
©8 The noisy-channel coding theorem 
(inference + probabilistic methods 
79-10 Inference 
711 Clustering 
www.inference.phy.cam.ac.uk/itprnn/ © 12-13 Monte Carlo methods 
www.inference.phy.cam.ac.uk/itila/ 914 Variational methods 
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Monte Carlo methods 


Simple Monte Carlo methods 
Importance sampling 
Rejection sampling 


Markov-chain Monte Carlo methods 
Metropolis method 
Gibbs sampling 
Slice sampling 


Reducing random-walk behaviour 
Hamiltonian Monte Carlo 
Overrelaxation 


Exact sampling 


Lecture 11 
Clustering 


Lecture 12 
Monte Carlo methods 


Lecture 13 
Advanced Monte Carlo methods 


Monte Carlo methods 


("Simple Monte Carlo methods 
Importance sampling 
Rejection sampling 


@Markov-chain Monte Carlo methods 
Metropolis method 
Gibbs sampling 


Slice sampling 


@Reducing random-walk behaviour 
Hamiltonian Monte Carlo 
Overrelaxation 


@Exact sampling 


Clustering 


K means clustering 
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Monte Carlo methods 


i = l px) = Eo 
Interested in P(x) = 2? (x) = zt A 
Can evaluate E(x) at any x. 

Problem 1 Make samples x") ~ P 


Problem 2 Estimate expectations $ = > d(x)P(x) 
х 


What we’re not trying to do: 
We're not trying to find the most probable state. 


We're not trying to visit all typical states. 
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Monte Carlo methods 


Simple Monte Carlo methods 
Importance sampling 
Rejection sampling 


Markov-chain Monte Carlo methods 
Metropolis method 
Gibbs sampling 
Slice sampling 


Reducing random-walk behaviour 
Hamiltonian Monte Carlo 
Overrelaxation 


Exact sampling 
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50 samples, 19 accepted 


50 samples, 27 accepted 
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Clustering 


ЕК means clustering 
Assign 
© Update 


(Soft K means clustering 
Assign 
© Update 


Clustering 


ЕК means clustering 
Assign 
© Update 


(Soft K means clustering 
© Assign 
© Update 


@Clustering by Gibbs sampling 
Assign 
© Update 
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("Simple Monte Carlo methods 
Importance sampling 
Rejection sampling 


@Markov-chain Monte Carlo methods 
Metropolis method 
Gibbs sampling 


Slice sampling 


@Reducing random-walk behaviour 
Hamiltonian Monte Carlo 
Overrelaxation 


@Exact sampling 


Problems with standard Monte Carlo methods 


@Random walk behaviour 

Efficient methods 
@Sensitivity to step size 

Slice sampling 


@When to stop 


Exact sampling 


